1/20 




+ 



Fig. 2A 







/ 




202^ 


1U 


CPU 





\ 



\ 



\ 



2/20 

Multi-Servers in Rack Form Factor 

240 ,208 
/ ^210 



2U 



CPU 



CPU 



CPU 



5U 



CPU 



CPU 



CPU 



ROOT 
COMPLEX 2 



ROOT 
COMPLEX 3 



SWITCH 
(ETHERNET) 



SWITCH 
(FIBER CHANNEL) 



SWITCH 
(OTHER) 



ROOT 7 






COMPLEX 1 







200 



.212 



/ 



216 



.214 



220 



218 



3-3 



3 



+ 



Fig. 2B 



3/20 

Multi-Servers in Blade Form Factor 



+ 



/ 



201 



.A 



270 



,254 ,252 ,250 



260 




\ 



222 



SWITCH 
(ETHERNET) 



223 



SWITCH 
(FIBER CHANNEL) 



224 



225 



SWITCH 
(OTHER) 



227 




210^ 


PCI 


ETHERNET 


^211 


ETHERNET 


SWITCH 


ETHERNET 




IF 


MAC 




MAC 


CORE 


MAC 1 



212^ 


PCI 


FIBER 
CHANNEL 
MAC 


^213 


FIBER 
CHANNEL 
MAC 


SWITCH 


FIBER 


l 22A 




IF 




CORE 


CHANNEL I 
MAC 


mmm\ 



214^ 


PCI 


OTHER 


/2 15 


OTHER 


SWITCH 


OTHER 


/ 226 




IF 


MAC 




MAC 


CORE 


MAC 1 


wmm\ 



+ 



Fig. 2C 



4/20 




3 



5/20 



300 

PCI EXPRESS SERVER ARCHITECTURE 



306 



\ 



CPU 



CPU 



/ 



304 



314 ^ 320 



316 



ENDPOINT 



PCI EXPRESS 
TO 

PCI BRIDGE 

, 1 



\ 



T 



.310 



ROOT 
COMPLEX 



320 



..i\318 



308 



MEMORY 



312 



320 



,322 



/ 



320 



PCI EXPRESS 
SWITCH 



320 



.320 



324^ 


FIBER 
CHANNEL 


326^ 


NIC 
ETHERNET 


328 \ 


OTHER 




i 






> 












f 






r 






f 



Fig. 4 



6/20 



400 



Multi-Servers in Blade Form Factor with Shared I/O Switch 



.Z. 



402 



,408 ,406 ,404 




,420 



422 ^424 ^426 



440 

ETHERNET 
MAC 






442 




FIBER" 




CHANNEL { 




MAC 



m 



430 



432/ 



m 

OTHER 
CONTROL 




.420 



PCI-EX 



SWITCH 
CORE 



PCI-EX 






441 


/ 




PCI-EX 


ETHERNET 


IF 


MAC a 



,440 



PCI-EX 
IF 


FIBER 


^442 


CHANNEL B 


H 


MAC 




PCI-EX 


OTHER 


^444 


IF 


MAC 11 





I/O Cards 



5 



7/20 



500 



MULTI-OPERATING SYSTEMS WITH SHARED I/O 




6 



8/20 



600 



MULTI-OPERATING SYSTEMS WITH SHARED ETHERNET CONTROLLER 



ROOT COMPLEX 1 



PORT 4 



602 



,603 



651. 



ROOT COMPLEX 2 



PORT 7 



604 



,605 



ROOT COMPLEX 3 



PORT 10 



606 



.607 





PCI EXPRESS 



610 



.640 



PCI EXPRESS+ 





1 






2 






3 






4 




MULTI-OS 
ETHERNET CONTROLLER 



650 



7 



9/20 



700 




1 




4 



MULTI-OS 
FIBER CHANNEL 
CONTROLLER 



8 



10/20 



800 



MULTI-OPERATING SYSTEMS WITH SHARED OTHER CONTROLLER 



ROOT COMPLEX 1 



PORT 4 



,802 



,803 



851. 



ROOT COMPLEX 2 



PORT 7 




804 



,805 




811 



ROOT COMPLEX 3 



PORT 10 



806 



,807 




PCI EXPRESS 



810 



-840 



PCI EXPRESS+ 





1 






2 






3 






4 




MULTI-OS 
OTHER CONTROLLER 



850 



Fig. 9 



11/20 
PCI EXPRESS PACKET 



+ 



900 



FRAME 



SEQUENCE 
NUMBER 



HEADER 



DATA 



ECRC 



LCRC 



1 



TRANSACTION LAYER 



t 



FRAME 



DATA LAYER 



PHYSICAL LAYER 



Fig. 10 



1 002 PCI EXPRESS+ PACKET FOR SHARED I/O 



1000 



FRAME 



SEQUENCE 
NUMBER 



OS DOMAIN 
HEADER 



1 



HEADER 



DATA 



ECRC 



LCRC 



TRANSACTION LAYER 



j 



FRAME 



DATA LAYER 



PHYSICAL LAYER 



Fig. 11 



OS DOMAIN HEADER 



1100 



BYTEO 
BYTE 4 



+0 

7 | 6 | 5 | 4 3 | 2 | 1 0 


7 I 6 


+1 

5 4 | 3 2 | 1 0 


7 6 


+2 

5 | 4 3 2 | 1 0 


+3 

7|e|5|4|3|2|l |0 


R 


RN 


R 


OSD 


PI 


R 



PI Protocol ID Field 

OSD OS Domain Number 

RN Resource Number (which buffer the packet belongs to) 

R reserved 



+ 



Fig. 12 (Prior art) 



12/20 



i 



1202 



1200 



1208 



CONTROL 
REGISTER 
LOGIC 



1212 



TRANSMIT 
LOGIC 



BUS INTERFACE 



/ 



1204 



.1206 



DATA PATH MUX 



_z 



1216 



DMA 
LOGIC 



PROCESSOR 
\l218 



1210 



EEPROM 



1214 



RECEIVE 
LOGIC 



+ 



13/20 



302 



1300 



1308 



BUS INTERFACE* 



CONTROL 
REGISTER 
LOGIC+ 



1304 



DATAPATH MUX+ 



1306 
< H 



1312 



TRANSMIT 
LOGIC+ 



1316 



DMA 
LOGIC+ 



PROCESSOR 
\l318 




DMA-1 



DMA-2 



.1330 
1332 



1336 



DESCRIPTOR-1 



DMA-N ' 



1334 



DESCRIPTOR-2 

"\l338 
! .1340 



DESCRIPTOR-N 



,1342 



ARBITRATION LOGIC 



1310 



EEPROM / 
FLASH+ 



1314 



RECEIVE 
LOGIC+ 









PCI-EXPRESS+ 


,1350 




INTERFACE 






PCI 


,1352 




TARGET 




PCI 


/ 1354 




CONFIGURATION 









14 



14/20 



+ 

1400 



MULTI-OPERATING SYSTEMS WITH SHARED ETHERNET CONTROLLER 

PACKET FLOW EXAMPLE 



ROOT COMPLEX 1 



PORT 4 



1402 



.1403 



1451. 



ROOT COMPLEX 2 



PORT 7 



1404 



.1405 



1408 



ROOT COMPLEX 3 



PORT 10 



1406 



.1407 





1411 



MULTI-OS 
ETHERNET CONTROLLER 



PCI EXPRESS 



1410 



.1440 



PCI EXPRESS+ 



.1450 



.1452 



OSD 


MAC 


OSD 
HEADER 


4 


A 


000100 


11 


B 


001011 


16 


C 


010000 


? 


D 


?????? 



Fig. 15 



15/20 



+ 



METHOD OF SHARED I/O DOWNSTREAM TRANSMISSION FROM SWITCH ^ 



1500 



BEGIN 



.1502 




IDENTIFY DOWNSTREAM PORT 



BUILD PCI EXPRESS* PACKET 
[IDENTIFYING ROOT COMPLEX] 



SEND PCI EXPRESS+ PACKET 
TO ENDPOINT 



TRACK PROCESS FOR PCI EXPRESS* PACKET 



.1506 



.1508 



.1510 



.1512 



DONE 



.1514 



+ 



16/20 



METHOD OF SHARED I/O UPSTREAM TRANSMISSION TO SWITCH 




.1608 



BUILD PCI EXPRESS PACKET 



SEND PCI EXPRESS PACKET 
TO ROOT COMPLEX 



.1610 



.1612 



TRACK PROCESS FOR PCI EXPRESS PACKET 



DONE 



.1614 



17 



17/20 



METHOD OF SHARED I/O DOWNSTREAM TRANSMISSION TO ENDPOINT f 



1700 



BEGIN 




.1702 



IDENTIFY OS DOMAIN 



PROCESS PCI EXPRESS+ PACKET UTILIZING RESOURCES 
ESTABLISHED FOR IDENTIFIED ROOT COMPLEX 



TRACK PROCESS FOR PCI EXPRESS+ PACKET 



.1706 



.1708 



.1710 



DONE 



.1712 



18 



18/20 



+ 



METHOD OF SHARED I/O UPSTREAM TRANSMISSION FROM ENDPOINT f 



1800 



1802 




IDENTIFY OS DOMAIN 



BUILD PCI EXPRESS+ PACKET IDENTIFYING OS DOMAIN 



TRANSMIT PCI EXPRESS* PACKET TO SWITCH 



TRACK PROCESS FOR PCI EXPRESS+ PACKET 



.1806 



.1808 



.1810 



.1812 



.1814 



DONE 



Fig. 19 



19/20 



+ 



/ 



1900 




+ 



+ 



o 
o 

CN 



CO 



O 

CL 
Q 

LU 
Q 

< 
CO 



O 



< 

CO 



LU 

eel 



o 



2 

< 



< 

Q 



O 

LU 

a: 

LU 

a 

CD 
CO 



+ 



O 
CNJ 




o 



o 
o 

CD 



O 




o o 
o o 
eg cm 





_l 
1— 




1 




o 




cc 




1— 




-z. 




o 




o 




o 
















o 








f 



